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Method and computer program for identification of 
inattent iveness by the driver of a vehicle 

The invention relates to a method and a computer 
10 program for identification of when the driver, of a 
vehicle, in particular of a motor vehicle, is not 
paying attention during operation of the vehicle. The 
invention also relates to a data storage medium with a 
computer program such as this. 

15 

Various proposals for detecting inattent iveness by a 
motor vehicle driver, in particular a tendency for the 
motor vehicle driver to go to sleep, are known from the 
prior art . 

20 

By way of example, one corresponding proposal is 
disclosed in German Laid-Open Specification 
DE 198 18 239 Al . The apparatus disclosed there for 
warning that a motor vehicle driver is going to sleep 

25 comprises firstly a vehicle environment identification 
device for detection of the actual driving style of the 
motor vehicle driver. The apparatus described there 
also comprises a device for detection of a reference 
driving style, in particular detecting how many lateral 

3 0 self -movements there normally are by the motor vehicle 
driver in his driving style. Finally, the disclosed 
apparatus has comparison logic for comparison of the 
reference driving style with the current actual driving 
style in order to output a warning to the motor vehicle 

35 driver on the basis of the result of this comparison. 

Furthermore, a method and an apparatus for 
determination of the stress of the driver of a motor 
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vehicle are known from US Patent Specification 
US 6,061,610. This method provides for the steering 
wheel angle of the motor vehicle to be detected first 
of all in order from this to generate prediction errors 
5 for the steering wheel angle in the driver's control of 
the motor vehicle. A distribution of these prediction 
errors is then calculated in order to compare this 
distribution with another distribution of prediction 
errors of the steering wheel angle which does not 
10 represent the real steering behavior of the driver, but 
represents a predetermined steering behavior of a 
stress- free or unstressed driver. The result of this 
comparison then represents the current stress on the 
driver while driving the motor vehicle. 

15 

Finally, German Laid-Open Specification DE 25 46 345 
discloses a driver warning device for warning motor 
vehicle drivers before they go to sleep. The device 
detects the steering movement of the driver of the 

2 0 motor vehicle, on the assumption that, when the driver 
is awake, the steering wheel is not held entirely at 
quiescent even when traveling in a straight line but 
that steering movements are also carried out 
continuously then, even if they are still very small. 

25 If the driver warning device detects absence of these 
steering movements over an adjustable time interval, as 
well, then the driver warning device deduces from this 
that the driver is going to sleep or is at least at 
risk of going to sleep, and then warns the driver by 

30 outputting a signal. 

The driver warning device disclosed in the 
last-mentioned Laid-Open Specification DE 25 46 345 has 
the disadvantage that the decision on when the driver 
35 of a vehicle is not paying attention is made solely on 
the basis of the detection of a steering quiescent 
phase, and that this decision can therefore be made 
only quite vaguely and unreliably. 
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Against the background of this prior art, the object of 
the invention is therefore to provide a method and a 
corresponding computer program in order to identify 
5 when the driver of a motor vehicle is not paying 
attention, as well as a controller for carrying out 
this method and a data storage medium with this 
computer program, which make it possible to more 
reliably identify possible inattent iveness of the 
10 driver. 

This object is achieved by the method claimed in patent 
claim 1. This method is characterized by the following 
steps: identification of a steering action following 

15 the steering quiescent phase and determination of the 
magnitude of the extent of this steering action by 
evaluation of the rate of change of the steering wheel 
angle and determination of a measure of the severity of 
the inattentiveness by the driver while steering the 

2 0 vehicle by assessment of the result of a link between 
the extent of the steering quiescent phase and the 
extent of the steering action . 

In the process of identification of inattentiveness of 
25 the driver, the invention - in contrast to the prior 
art - advantageously distinguishes between a steering 
quiescent phase and a more or less hectic steering 
action which typically follows a state of 
inattentiveness. Thus, according to the invention, a 
30 state of inattentiveness is not assumed at all unless 
both the steering quiescent phase and the subsequent 
steering action are identified in conjunction with one 
another; conversely, this means that just 

identification of a steering quiescent phase or of a 
35 steering action is not sufficient to deduce 
inattentiveness of the driver. The detected extents of 
both the quiescent phase and of the steering action are 
logically linked to one another for determination of 
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the extent of the severity of the inattentiveness, and 
the result is then assessed. 

In modern vehicles, in particular motor vehicles, a 
5 sensor for detection of the steering wheel angle x is 
normally provided in any case. Thus, in principle, no 
additional sensors are advantageously required to 
implement the described method. 

10 Two different exemplary embodiments for implementation 
of the invention will be explained in the description. 
The first exemplary embodiment is represented by patent 
claims 2-5, and the second exemplary embodiment is 
represented by patent claims 6-11. In principle, a 

15 specific way to determine the extent of the steering 
quiescent phase is provided for the second exemplary 
embodiment; however, this determination process can 
also be carried out according to the first exemplary 
embodiment . 

20 

Further refinements of the method, as are described in 
claims 12-16 and 17-19, apply equally both to the first 
exemplary embodiment and to the second exemplary 
embodiment . 

25 

Advantages of the first exemplary embodiment 

Calculation of the extent of the steering action solely 
by formation of a steering wheel angle variance would 

3 0 merely represent the steering behavior of the driver at 
one time. However, in order to make a reliable 
statement on the existence of inattentiveness, it is in 
fact important to take account of changes in the 
steering behavior over time, as well. According to the 

35 invention, this aspect is taken into account by 
including two steering wheel angle variances in the 
formation of the variance ratio, which each represent 
the steering action of the driver at different times, 
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with the two times being offset through a time interval 
At with respect to one another. 

The variance ratio calculated according to the 
5 invention can intrinsically advantageously be 
interpreted as a measure of the severity of the 
inattentiveness of the driver while steering the 
vehicle at the time ti; inattentiveness of the driver 
exists in particular when this variance ratio has a 
10 value greater than 1. 

Advantages of the second exemplary embodiment 

In contrast to the first exemplary embodiment, the 
15 second exemplary embodiment makes use of considerably 
fewer parameters for assessment of the inattentiveness 
of the driver. It is therefore less memory intensive. 
Furthermore, owing to the use of considerably simpler 
algorithms, it can be coped with more easily and can be 
2 0 implemented in real time. Overall, it is therefore 
highly suitable for practical use in a vehicle. 

It is thus advantageous that an assessment of the 
extent of the steering quiescent phase, that is to say 

2 5 its time duration, is preferably made only by 

evaluation of the steering wheel angle, and the extent 
of the steering action is preferably determined only by 
detection of the maximum steering angle wheel gradient 
that occurs . There is therefore no need for any 
30 calculation or evaluation based on the variance 
function . 

Logically linking the extent of the steering quiescent 
phase to the extent of the steering action in order to 

3 5 determine a measure for the severity of the 

inattentiveness by the driver is carried out in the 
second exemplary embodiment by means of a 
multidimensional operator. In order to save unnecessary 
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computation complexity, this logical operation is, 
however, preferably carried out only when both the 
steering quiescent phase and the expected subsequent 
steering action each take place with a predetermined 
5 minimum extent. If the steering quiescent phase or the 
steering action are not sufficiently sharply 
pronounced, then, according to the invention, it is 
assumed that the driver is not in a state of 
inattentiveness . 

10 

Advantages of the refinements of the method according 
to the invention which both exemplary embodiments may 
have jointly. 

15 The result of the logical operation from the first or 
second exemplary embodiment, that is to say the 
variance ratio or the result of the operator logical 
operation, can advantageously be mapped onto a 
probability value with the aid of the sigmoid function. 

20 This means that it is possible to specify a probability 
between 0 and 100% of the driver having been 
inattentive in the steering of the vehicle at the time 
ti. 

25 In a further advantageous refinement, the claimed 
method based on the previously determined probability 
value allows a statement to be made on the probability 
with which the behavior of the driver can be associated 
with one specific fatigue level which is suitably 

3 0 selected and is predetermined from a large number of 
such levels. According to the invention, an association 
such as this is always made taking into account the 
currently detected steering wheel angle. 

35 This association with the predetermined fatigue levels 
can advantageously be made more precise by taking into 
account not only the steering wheel angle as a first 
indicator but also further observable indicators for 
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the inattentiveness by the driver, such as his eyelid 
closure behavior or his reaction time. 

It is also advantageous that the estimate of the 
5 fatigue of the driver can also be made more precise by 
taking account for this estimate not only of the 
currently detected values of, in particular, the stated 
indicators, but also the fatigue classifications 
carried out in the recent past. In other words, this 
10 procedure allows a plausibility check of the new 
estimate taking into account the fact that the driver 
fatigue is not a phenomenon which occurs or disappears 
again suddenly, but which in fact changes only 
continuously over the course of time. 

15 

The claimed method advantageously allows not only, as 
described above, a conclusion to be drawn about driver 
fatigue as the cause of the detected inattentiveness. 
In fact, it also allows a conclusion to be drawn 
20 relating to other causes for the detected 
inattentiveness, which, for example, may lie in a 
conversation being held with a front seat passenger or 
the operation of an apparatus, such as the radio or the 
glove compartment in the vehicle. 

25 

In order to improve the reliability of a statement 
relating to the attention level or inattentiveness of 
the vehicle driver, it is worthwhile evaluating not 
only a result of the logical operation according to the 

3 0 first or second exemplary embodiment but, instead of 
this, for this statement to be based on a large number 
of such logical operation results. In this case, this 
plurality may comprise not only merely results from the 
first or from the second exemplary embodiment, but also 

3 5 a mixture of results from the first and from the second 
exemplary embodiment. Specifically, a statement can be 
made more reliably about the inattentiveness by the 
driver by weighting each result obtained from a logical 
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operation with an associated weighting factor in order 
then to obtain an averaged logical operation result in 
the final analysis from the present plurality of 
weighted logical operation results, by mathematical 
5 averaging. This averaged logical operation result then 
represents a more reliable measure than a non- averaged 
logical operation result of the severity of the 
inattentiveness by the driver in the steering of the 
vehicle at a specific time. 

10 

Finally, it is advantageous, in particular, for the 
driver of the vehicle to be informed of the identified 
inattentiveness in the form of visual or audible 
warning information . 

15 

Further advantageous refinements of the method are the 
subject matter of the dependent claims. 

The object of the invention as mentioned above is also 
2 0 achieved by a computer program for carrying out the 
described method, by a data storage medium with the 
computer program, and by a controller for carrying out 
the described method. The advantages of these solutions 
correspond to the advantages mentioned above with 

2 5 respect to the described method. 

This computer program advantageously need be programmed 
only once at least for individual vehicle types, and 
can then be implemented in all the vehicles of a 

3 0 corresponding model. 

In the drawing : 

Figure 1 shows a controller according to the 
3 5 invention; 

Figure 2 shows an example of the profile of the 

steering angle x when driver inattentiveness 
occurs, according to the invention; 
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Figure 3a shows the procedure for the method according 

to the invention based on a first exemplary 
embodiment ; 

Figures 3b, c in conjunction with Figure 3a show the 
5 procedure for the method according to the 

invention based on a second exemplary 
embodiment ; 
Figure 4 shows a sigmoid function; 

Figure 5 shows a first cause and effect diagram; 
10 Figure 6 shows Gaussian distributions for various 

extent levels in which a probability value 
which represents the inattentiveness by the 
driver may occur; and 

Figure 7 shows a second cause and effect diagram. 

15 

Figure 1 shows a controller 100 for carrying out the 
method according to the invention for identification of 
inattentiveness by the driver of a vehicle, in 
particular of a motor vehicle. The controller is 

20 preferably mounted in the vehicle (not shown) and 
comprises a steering wheel angle sensor 110 for 
detection of the current steering wheel angle x, that 
is to say the steering movement, caused by the driver. 
The controller 100 furthermore comprises a control 

2 5 device 12 0, which is preferably in the form of a 
microcontroller. The control device 120 detects a 
sensor signal which is produced by the steering wheel 
angle sensor 110 and represents the steering wheel 
angle x. 

30 

The steering wheel angle x represents a first 
indicator, which is preferred according to the 
invention, for inattentiveness by the driver. In 
addition to the steering wheel angle, the control 
35 device 120 can also in principle receive and evaluate 
further sensor signals from other sensors 112, 114 as 
further indicators for the inattentiveness by the 
driver. Such further sensor signals will be ignored 
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initially, but are mentioned further below in the 
description . 

Inattentiveness by the driver is identified by running 
5 a computer program 122 in the control device 120, which 
identifies the inattentiveness using a method according 
to the invention and described in the following text by 
evaluation of the steering wheel angle x as a preferred 
indicator. If inattentiveness by the driver is found, 

10 then it is advantageous for the control device 12 0 to 
drive a warning device 130 in order that it emits 
audible or visual warning information to the driver. 
The warning information makes the driver aware of his 
inattentive behavior in driving of the vehicle, and 

15 provides him with the opportunity to re-establish his 
attention . 

Figure 2 shows a typical profile of the steering wheel 
angle, as occurs when inattentiveness by the driver has 
20 been identified with the aid of the present invention. 
To this extent, this profile is typical of the 
existence of inattentiveness by the driver in which, 
first of all, he has a steering quiescent phase LR in 
which he makes no significant changes; in Figure 2, the 

2 5 steering angle x remains in the deflection range Ax, 

which is bounded by the two parallel horizontal lines, 
throughout the steering quiescent phase LR. The 
presence of inattentiveness in the sense of the 
invention is then characterized by a very sharp or 
30 powerful steering action which follows this steering 
quiescent phase. This powerful steering action LA is 
represented in Figure 2 by the rapid rise in the 
steering angle x at the end of the quiescent phase. 

3 5 Figure 3 shows the method according to the invention, 

implemented with the aid of the controller 100 
described above. The method steps SO - S8 shown in 
Figure 3a first of all represent a first exemplary 
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embodiment of this method. This will be described first 
of all in the following text in detail and in a related 
form. The branches A, B, C and D shown in Figure 3a are 
irrelevant to this first exemplary embodiment; these 
5 will not become relevant until the description of a 
second exemplary embodiment of the method according to 
the invention, which follows the description of the 
first exemplary embodiment. 

10 First Exemplary Embodiment 

Following a starting step SO, the first exemplary 
embodiment as shown in Figure 3a first of all provides 
for the detection of a steering movement of the 

15 steering wheel of the vehicle, that is to say the 
detection of the steering behavior of the driver in the 
form of the steering wheel angle x (method step SI) . 
The steering quiescent phase LR, see Figure 2, is then 
identified in a second step S2 on the basis of the 

2 0 detected steering wheel angle x. A variance ratio w 
(x, ti) is then likewise calculated in step 2, as the 
quotient of a second divided by a first steering wheel 
angle variance. In this case, the first steering wheel 
angle variance v(x, ti - At) at an early time t x - At is 

2 5 calculated using the following formula (1) : 



(t x -At-T) 

v(x, t 2 -At) =var (x (ti-At) , x (t x -At-T) ) =— ^(x(t)-x) 2 (1) 



where : 

30 x(ti-At) represents the steering wheel angle x at the 

time ti-At; 

At represents a multiple of the sampling 

interval ; 

T represents an observation time window; 

3 5 ti-At represents the observation time; 
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x represents a time mean value of the steering 

wheel angle x averaged over the observation 
time window T; and 
var represents the mathematical variance 

5 function. 

The second steering wheel angle variance v(x, ti) is 
calculated using the following formula (2) : 

I «i-T) _ 

10 vfx, t 2 )=var(x(t 1 ) / x(ti-T) ) =— £(x(t)-x) 2 (2) 

T t=(t,> 

where the variables have the same meanings as in the 
formula (1) with the only difference being that they 
are considered at the observation time ti. 

15 

The variance ratio w(x,ti) is then calculated from the 
first and second steering wheel angle variances as 
follows : 

20 w(x,ti)= — (3) 

v(xj x - At) 

The variance ratio calculated in the method step S2 
therefore represents a reliable measure of the severity 
of the inattentiveness of the driver in steering of the 

25 vehicle at the time ti, because it effectively records 
the typical steering behavior of a driver when he is 
not paying attention. A typical steering behavior when 
the driver is not paying attention is 
characterized - as has already been stated above with 

30 reference to Figure 2 - by a first steering quiescent 
phase LR without any steering activity, or with only a 
minor amount of steering activity, and by a subsequent 
second steering action phase LA with above-average 
powerful steering movements. The first phase leads, at 

35 the early observation time ti - At, to the first 
variance at a small magnitude. In contrast, the second 
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phase, in particular at the time ti, leads to a 
considerably greater value for the second variance. 
Overall, this results in a small value for the 
denominator and a large value for the numerator, so 
5 that, overall, these two effects result in a high value 
for the variance ratio. As long as the variance ratio 
is < 1, this indicates that the driver is not 
inattentive. Only when the variance ratio assumes a 
value greater than 1 does this indicate that the driver 
10 of the vehicle is not paying sufficient attention to 
the road traffic. 

The value of the variance ratio may in theory be 
indefinitely high. However, indefinitely high values of 
15 this type are unsuitable to allow the inattent iveness 
of the driver to be classified sufficiently accurately. 

In one particular variant of the method according to 
the invention, the variance ratio is therefore 

2 0 converted to a probability value in a subsequent method 
step S3 . This conversion is preferably carried out with 
the aid of a sigmoid function, which is illustrated in 
Figure 4 and has a suitable predetermined threshold 
value SW. This threshold value for the sigmoid function 

25 illustrated in Figure 3 is SW = 2. This means that a 
variance ratio w(x, ti) (which is plotted on the 
abscissa in Figure 3) of 2 indicates a probability 
P (U n ) , where n = 1 (first indicator), of 0.5, that is to 
say of 50%, of the driver of the vehicle having been 

30 inattentive at the time ti. As can be seen from the 
graph of the sigmoid function in Figure 3, the 
probability P(Ui) may in principle assume a value 
between 0 and 100%, depending on the magnitude of the 
variance ratio. 

35 

The sigmoid function ensures a "soft" transition from 
total attention corresponding to a probability value 
for the instantaneous inattentiveness of 0 to total 
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inattention, corresponding to a value for the 
inattentiveness of 1 = 100%. Mathematically, the 
sigmoid function illustrated in Figure 3 is calculated 
using the following formula (4) : 

p(ui) = i + e -L,^ < 4 >' 

where 

P(Ui) represents the probability of the 

inattentiveness by the driver in steering of 

the vehicle, with 
Ui representing an inattentiveness event detected 

with the aid of the first indicator (steering 

wheel angle: n = 1) , and 
S representing the threshold value. 

The evaluations of the steering wheel angle x carried 
out so far (that is to say up to and including the 
method step S3) have allowed identification of the 
presence or absence of inattentiveness by the driver at 
the time ti. A further evaluation of the knowledge 
obtained up to this point, preferably with the aid of a 
dynamic probabilistic model, further allows conclusions 
to be drawn relating to the possible causes of 
inattentiveness that has been found. The method steps 
S4 - S6, which will be described in the following text, 
therefore indicate a method with whose aid, for 
example, it is possible to determine the probability of 
fatigue being the cause of the driver inattentiveness 
that has been detected. 

This relationship which has just been described between 
fatigue as the cause of inattentiveness in the steering 
of the vehicle resulting from this is illustrated in 
Figure 5. The arrows shown there point from fatigue as 
the cause to various possible effects, in particular to 
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inattentiveness in the steering of the vehicle 
(indicator 1) . In addition to the effect of 
inattentiveness, fatigue may, however, also have other 
observable effects, such as frequent closure of the 
5 eyelids (indicator 2) or a delayed reaction capability 
(indicator 3) . 

In order to make it possible to deduce driver fatigue 
from a detected inattentiveness event in the steering 

10 of the vehicle, a first probability vector O n= i is, 
according to the invention, determined in the method 
step S4, whose elements 0 n =i, kn=i each represent 
probability values of the probability value P (Ux) 
occurring in individual, predetermined and suitably 

15 selected extent levels k n where k n e {l.„K} . The 
parameter n in this case represents a respectively 
evaluated indicator, with n = 1 representing the 
steering behavior or the steering wheel angle as an 
indicator . 

20 

Figure 6 illustrates the process for determination of 
the first probability vector O n=i . In this figure, the 
probability value P(U X ) as determined in the previous 
method step S3 is plotted between 0 and 100% on the 

25 abscissa, representing the probability of 

inattentiveness by the driver in steering of the 
vehicle at the time ti- The previously determined 
probability value P(Ui) will now be predetermined in the 
method step S4, and associated with suitable defined 

30 extent levels k n e (l^Kx) . In the exemplary embodiment 
shown in Figure 6, three extent levels were 
predetermined, "low" (k x = 1) , "medium" (ki = 2) and 
"high" (ki = 3) (see Figure 5) for the indicator 1, and 
each represented by their own Gaussian function in 

35 Figure 6. The number of extent levels for the indicator 
1 in this example is thus k x = 3 . 
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The number and parameters of these Gaussian functions 
for the respective extent levels, such as their center 
points or their variances, can be configured 
appropriately depending on the application. As can be 
5 seen from Figure 6, a probability of 70% of this 
probability value occurring with only a small extent 
would be associated, after carrying out the method step 
S4, with a probability value P(Ui) (assumed by way of 
example) of 0.33 for the inattentiveness by the driver. 
10 There is a 28% probability of the calculated 
probability value occurring with a medium extent, while 
there is a probability of only 2% of the calculated 
probability value occurring with a high extent. 

15 In other words, in the case of the example illustrated 
in Figure 6 for the assumed probability value of 0.33 
for the inattentiveness by the driver at the time ti, 
results in the statement that the probability of 
inattentiveness by the driver having only a low extent 

20 occurred with a probability of 70%, that is to say 
there was a 70% probability that the driver was paying 
attention. This also results in the statement that 
there was a probability of 28% that the driver was 
paying medium attention, and that there was a 

25 probability of only 2% of him being highly inattentive. 

An indefinite number of fatigue levels can now be 
defined in the next method step S5, and conditional 
probabilities between these levels as well as the 

3 0 observed steering inattentiveness event can now be 
allocated. In the example shown in Figure 5, a total of 
three fatigue levels "awake", "tired" and "fatigued" 
are provided. Conditional probabilities can then 
likewise be allocated, also in the method step S5, in 

35 the form of a matrix B between each of these fatigue 
levels and one of the extent levels described above. 
This matrix B covers a total number of matrix elements 
which is calculated from the product of the number of 
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extent levels multiplied by the number of predetermined 
fatigue levels. If there are three extent levels "low", 
"medium" and "high" for the steering inattentiveness 
event, the three fatigue levels mentioned above result 
in a total number of 3*3=9 conditional 
probabilities for the matrix B. By way of example, one 
of these probabilities indicates how high the 
probability is of a steering inattentiveness event in 
the "high" extent level occurring, given that the 
probabilistic model in the first fatigue level is 
"awake" . These conditional probabilities can be 
configured appropriately . 

With the probability vector O n= i as determined in step 
S5, and the calculated matrix B, it is now possible to 
determine, in a method step S6, a fatigue probability 
vector S 1 , whose elements each represent probabilities 
P (fatigue level) , of the detected inattentiveness by 
the driver in steering of the vehicle being associated 
with individual, predetermined and suitably selected 
fatigue levels. The fatigue probability vector S 1 is 
calculated using the following formula (5) : 

S' (t)=O^B! (5) , 

where 

oLi represents the transpose of the first probability 
vector; and 

Bi represents the matrix B for the detected indicator 
for steering inattentiveness, represented by the 
index 1 . 

The calculation rule (5) just described for calculation 
of the fatigue probability vector S' has the 
disadvantage that it is based only on an evaluation of 
the steering wheel angle x as an indicator (n=l) . Other 
possible observable effects of fatigue, such as those 
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indicated in Figure 5 by the indicators 2 (for example 
eyelid closure frequency) or the indicator 3 (for 
example reaction time) are not included in the formula 
5 for calculation of the fatigue probability vector. 

5 

However, it is also possible to use these indicators 2 
and 3 as well as further suitable indicators n, for 
example the yaw angle of the vehicle, the distance from 
the vehicle in front or the leaving of a lane, to the 

10 extent that these can be measured, for calculation of a 
more precise fatigue probability vector S 11 . The method 
steps S4 and S5 which have just been described must 
then be carried out in each case not only for the 
observed steering angle as the indicator n = 1, but 

15 also for further desired indicators such as the eyelid 
closure behavior (n = 2) and/or reaction time (n = 3) , 
etc., separately (method step S5a) . In the course of 
method step S4 , an individual number of extent levels k n 
where k n = 1...K must then be defined individually for 

2 0 each indicator n. This number of extent levels k n then 
in each case corresponds to the number of elements in a 
probability vector O n associated with the respective 
indicator. These elements O n ,kn in each case represent 
probabilities P(O n _,kn) of probability values P(U n ) for 

2 5 the other inattentiveness indicators n = 2..JSF occurring 

in addition to the steering inattentiveness n = 1 in 
the individual extent levels k n which are predetermined 
and suitably selected individually for the indicators. 

3 0 A corresponding matrix B n can then also be predetermined 

individually for these further indicators n, 
corresponding to the method step S5, once again. The 
more precise fatigue probability vector S' f is then 
calculated on the basis of the data that is then 
35 available in step S6, using the following formula (6): 

N 

S' 1 (t)=Yl°» B n (6) , 
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where : 

n represents the n-th indicator for the 

inattentiveness by the driver, 
k n represents the k-th element of the vector O n or the 

k-th extent level for the indicator n; 
On represents the transpose of a probability vector; 
B n represents the matrix of conditional probabilities 

between individual predetermined fatigue levels 

and an inattentiveness event which is indicated by 

the indicator n; and 
N represents the number of indicators used. 

In the two variants which have been described so far 
for calculation of the fatigue probability vector S, 
only the severity of a detected inattentiveness event 
has been traced back to the most probable actual 
fatigue level, be this on the basis of a detected 
steering inattentiveness event or else on the basis of 
additionally detected events, such as increased eyelid 
closure behavior or shortened reaction time. Further 
details of this process of tracing back from the 
observed inattentiveness to an existing fatigue level 
as the cause of this inattentiveness can be achieved by 
taking account not only of the severity of the 
inattentiveness event but also the most probable 
fatigue level determined in a previous time interval. 
This ensures that once an inattentiveness event has 
been detected, or has been detected for the first time, 
this does not in itself lead immediately to the 
conclusion that the fatigue level is high. This would 
not be consistent with the actual characteristic of 
fatigue since, in principle, fatigue is a phenomenon 
which does not occur suddenly, but builds up slowly 
only over the course of a certain period of time. 

In the case of the three fatigue levels mentioned above 
and described in Figure 5, the change from one fatigue 
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level to another is therefore provided with different 
conditional probabilities. These conditional 

probabilities are preferably predetermined in a 
suitable manner in the form of a matrix A in the course 
5 of the probabilistic model. The conditional 
probabilities in the matrix A are intended, in 
particular, to express the fact that, for example, a 
direct transition from fatigue level 1 "awake" to 
fatigue level 3, "fatigued" is considerably less 

10 probable than a direct transition from level 1 to level 
2, "tired", in which, in comparison to level 1, initial 
adverse effects in terms of the attention of the driver 
can now be identified. The configuration of the matrix 
A should also take account of the fact that the 

15 transitions from being awake to a state of greater 
fatigue take place with different conditional 
probabilities, in the same way as the transitions from 
a fatigued state to being awake. 

2 0 With the most probable fatigue level determined in a 
pervious time period also being taken into account, the 
fatigue probability vector S' 1 which has once again 
been made more precise in this way, is then calculated 
in step S7 using the following recursive formula (7) : 

25 

S' ' ' (ti) = S' ' (ti) • A • S 1 ' 1 (tx - 1) (7) , 

where 

30 S' ' (ti) represents the more precise fatigue vector 

S ,! without consideration of the most 
probable fatigue level determined in the 
previous time interval; 
A represents the matrix of conditional 

35 probabilities between a fatigue level in the 

most recent time interval and a current 
fatigue level; and 
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S 1 1 1 (ti-1) represents the more precise fatigue vector 

S' ' ' in the time period ti - 1 . 

It is recommended that an initial value of S' 1 ' 
5 (0) = (1, 0, 0) T be used as the third variant in order 
to start the recursive calculation of the more precise 
fatigue probability vector S 1 • 1 using the formula (7) . 

In other words, the more precise calculation of the 
10 fatigue probability vector S 1 ' 1 using the formula (7) 
results in the fatigue vector being smoothed over time, 
and/or prevents an inattentiveness event which has been 
identified for the first time immediately leading to a 
sudden change in the fatigue level which is assumed to 
15 be the most probable cause of the detected 
inattentiveness event. Suitable configuration of, in 
particular, the matrix A also ensures that, conversely, 
a high degree of attention by the driver, which is 
detected suddenly, does not immediately lead to a low 
20 fatigue level if a very high fatigue level has been 
determined to be the probable cause of detected 
inattentiveness immediately before this. 

The method described so far has always had the aim of 

2 5 deducing a certain fatigue level as the cause of the 

detected inattentiveness on the basis of detected 
steering inattentiveness and, optionally, also on the 
basis of further indicators for inattentiveness by the 
driver. This is illustrated once again in graphical 

3 0 form in Figure 7, where the arrows point from a cause 

to an effect. However, the directions of the arrows in 
Figure 7 also show that, according to the model on 
which this is based, the fatigue is immediately the 
sole cause for the indicators 2, that is to say the 
35 eyelid closing behavior, and 3, that is to say 
shortened reaction time, but that this need not be the 
only cause of detected steering inattentiveness. In 
fact, in addition to or as an alternative to fatigue, a 



1 



P802813/WO/1 - 22 - 

given temporary distraction of the driver may also be 
the cause of detected driver steering inattentiveness . 
The reason for distraction may in turn be, for example, 
a conversation being held with the front seat passenger 
5 or an action carried out on a control element, for 
example the radio or the glove compartment in the 
vehicle. If, in addition to the previously mentioned 
inattentiveness events or indicators, possible causes 
for distraction are also additionally detected with the 

10 aid of suitable sensors, such as a microphone 112 or a 
camera 114 (see Figure 1) , then these detected events 
can be evaluated with the aid of the probabilistic 
model in order to make a statement about the 
probability with which it can be assumed that the 

15 driver has been distracted, for example owing to a 
conversation being held or a control action being 
carried out, and the probability of fatigue being the 
cause of the observed inattentiveness. 

2 0 The driver inattentiveness which is detected by one of 

the variants of the first exemplary embodiment is 
finally compared with an error criterion, in particular 
with a respectively suitably predetermined threshold 
value, in order then to output a warning signal to the 
25 driver on the basis of the result of this comparison 
(method step S8 as shown in Figure 3a) . 

Second Exemplary Embodiment 

3 0 The second exemplary embodiment of the method according 

to the invention is admittedly in principle independent 
of the first exemplary embodiment, but has individual 
method steps which are identical to the individual 
method steps from the first exemplary embodiment. One 
35 fundamental difference between the first and the second 
exemplary embodiment is that, in the first exemplary 
embodiment, the identification of a steering action LA 
and the calculation of a logical operation result 
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between the extent of the steering quiescent phase and 
the extent of the steering action coincide in the form 
of the calculation of the variance ratio. In contrast, 
the second exemplary embodiment offers the advantage 
5 that not only the steering quiescent phase LR but also 
the subsequent steering action LA and the logical 
linking according to the invention of the extents of 
these two phases can in each case be carried out 
separately as separate method steps, as will be 
10 described in more detail in the following text with 
reference to Figures 3a, 3b and 3c. 

After a starting step SO, the second exemplary 
embodiment as shown in Figure 3a first of all provides 

15 for the detection of the steering movement of the 
steering wheel of the vehicle, that is to say the 
detection of the steering behavior of the driver in the 
form of the steering wheel angle x (method step SI) ; to 
this extent, the first and the second exemplary 

20 embodiment still coincide. For the second exemplary 
embodiment, this is now not followed by the method step 
S2 as shown in Figure 3a, but the method branches via 
the mark A to Figure 3b, while the extent of the 
steering quiescent phase is first of all determined in 

25 the method step S2/2. The extent of the steering 
quiescent phase means, in particular, its time 
duration. A steering quiescent phase exists for as long 
as the steering angle of the vehicle is within a 
predetermined steering wheel angle interval Ax, see 

30 Figure 2. The time period for which this situation 
lasts then represents the extent of the steering 
quiescent phase LR. 

The extent of a steering action following the detected 
35 steering quiescent phase is then detected in a method 
step S3/2. The maximum gradient of the steering angle 
which then occurs is determined for this purpose. In 
Figure 2, this gradient is illustrated in the form of 
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the gradient of the steering angle, how it occurs, once 
the steering wheel angle has left the steering wheel 
angle interval Ax. 

5 The extent of the steering quiescent phase and of the 
steering action are then linked to one another in the 
method step S4/2 by means of a multidimensional 
operator. The multidimensional operator may be a family 
of characteristics, a weighting function or a logical 

10 decision function. The result of this use of the 
multidimensional operator then represents a suitable 
measure for the severity of the inattent iveness of the 
driver in steering of the vehicle. The logical linking 
of the two extents which have been mentioned is, 

15 however, preferably carried out only when it has been 
found in the steps S2/2 or S3/2, which were carried out 
prior to this, that the extent of the steering 
quiescent phase in the form of its time period is 
greater than a predetermined minimum time period, and 

20 the maximum gradient of the steering wheel angle is 
greater than a predetermined gradient threshold value. 
Otherwise, the extents of the steering quiescent phase 
and of the steering action are not regarded by the 
method according to the invention as being sufficiently 

2 5 strongly pronounced in order to allow the deduction of 

driver inattentiveness as a result of their combined 
presence . 

The multidimensional operator is preferably dimensioned 

3 0 on the basis of the current speed of the vehicle and/or 

on the basis of the dynamics of the driving style of 
the vehicle driver. Specifically, this means that the 
evaluation of the detected extents of the steering 
quiescent phase and of the steering action take account 
35 of the fact that the steering movements are typically 
less at high vehicle speeds than at low speeds. 
Matching to the driving style of the driver prevents a 
hectic steering movement which is carried out 
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deliberately, for example by a rally driver, in 
conjunction with a previously detected supposed 
steering quiescent phase incorrectly being interpreted 
as driver inattentiveness. 

5 

The logical operation result determined in method step 
S4/2 according to the second exemplary embodiment can 
now be evaluated and processed further in various ways. 

10 A first option is to normalize this with the aid, for 
example, of the sigmoid function. This option is shown 
by the mark B in Figure 3b, which branches to the input 
of the method step S3 in Figure 3a. It is then possible 
to carry out not only the method step S3, but then also 

15 all the further method steps S4 to S8, as described 
above with reference to Figure 3a. 

A second option for further processing of the logical 
operation result obtained in the method step S4/2 

20 admittedly once again comprises the normalization 
process with the aid of the sigmoid function in method 
step S3, but the evaluation process does then not 
continue further in accordance with method step S4 and 
so on, but, as is indicated by the mark C in Figure 3a, 

25 the further processing continues in method step S9, as 
shown in Figure 3c. This step indicates that the 
calculation of the logical operation result which has 
already been carried out, irrespective of whether this 
was in accordance with the first exemplary embodiment 

3 0 in step 2 or in accordance with the second exemplary 
embodiment in step S4/2, should be carried out more 
than once during a predetermined measurement time 
interval. The repeated calculating of the logical 
operation results at different times ti where i = 1-1 

3 5 throughout the measurement time interval leads to a 
large number of logical operation results, preferably 
being available at the end of the measurement time 
interval. These logical operation results are 



1 



» 



P802813/WO/1 - 26 - 

preferably (as already described) tapped off at the 
output of the method step S3, because they are then in 
a normalized form. However, alternatively, the logical 
operation results which have been obtained directly in 
5 the method steps S2 and S4/2 can also be collected and 
stored directly in method step S9 . These logical 
operation results are then individually weighted in the 
method step S10, by allocating a weighting factor to 
each of these results. These weighting factors 
10 represent the respective driving situation of the 
vehicle or the current distraction of the driver, in 
each case at a time to which the logical operation 
result relates . 

15 Then, finally, a weighted logical operation result is 
calculated in the method step Sll by mathematical, 
preferably arithmetic, weighted averaging of the 
logical operation results obtained during the 
measurement time interval, taking into account the 

2 0 weighting factors associated with them. 

The weighting factors are defined taking into account 
the time of day, that is to say circadian influencing 
factors and/or the time since the start of the journey. 

2 5 The weighted result of the logical operation provides a 

very reliable measure which, in particular, is 
relatively simple and fast, for the severity of the 
inattentiveness of the driver while driving the 
vehicle. This averaged result of the logical operation 

3 0 is then preferably subjected to an error criterion, as 

in Figure 3c in conjunction with Figure 3a via the mark 
D in the method step S8, and is evaluated in order to 
generate a warning signal for the driver. The error 
criterion is satisfied when the sum of all of the 
35 logical operation results calculated in the most recent 
x minutes, in each case weighted with their individual 
weighting factors, exceeds a predetermined threshold 
value . 
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The second option, as described above, for further 
processing of the logical operation result obtained in 
the method step S4/2 according to the second exemplary 
5 embodiment, by means of the steps S9 to Sll, is also 
appropriate, in the same way, for the logical operation 
result obtained in the method step S2 according to the 
first exemplary embodiment. 

10 A third option for further processing of the logical 
operation result from step S2 or from step S4/2 is to 
preferably carry out the steps S4 to S7 and S9 to Sll 
in parallel, in time. 

15 The two exemplary embodiments of the method according 
to the invention, in all of their variants, are 
preferably implemented in the form of at least one 
computer program. If required, the computer program may 
be stored together with further computer programs in a 

2 0 data storage medium. The data storage medium may be a 
floppy disk, a compact disk, a so-called flash memory 
or the like. The computer program which is stored in 
the data storage medium can then be sold as a product 
to a customer. As an alternative to transferring it in 

25 the form of a data storage medium, it is also possible 
to transmit it via a communications network, in 
particular the Internet. 



